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METHOD AND SYSTEM FOR INTERNET PERSONALIZATION 



BACKGROUND OF THE INVENTION 



5 1 . Field of the Invention: 

The present invention relates generally to a method and system for creating a 
personalized display for a user of an electronic network. More specifically, the present 
invention relates to a method and system for determining a user's interests from the content 
of electronic documents viewed by the user and providing recommended documents and 
1 0 recommendation packages to a user based upon the determined interests. 

2. Description of Related Art: 
O The number of Internet users continues to increase at an explosive rate. The World 

Wide Web ("Web") has therefore now become a significant source of information, as well as 
jfi 15 products and services. 

| J As the numbers of Web users rise, Internet commerce, also referred to as "e- 

ij commerce" companies, and content providers are increasingly searching for strategies to 
|!y target their information, products and services to those Web users. One technique that is 
j; 3 currently being used to provide Web users with more relevant and timely information is 
Sj 20 "personalization." 

: w ! Personalization can include sending a user an e-mail message tailored to that user, or 

ij3 providing customized Web pages that display information selected by, or considered of 
v3 interest to the user. Personal merchandising, in which a unique view of an online store, 
featuring offerings targeted by customer profile is displayed, is another effective 
25 personalization technique. Personalization facilitates the targeting of relevant data to a select 
audience and can be a critical factor in determining the financial success of a Web site. 

Internet companies wishing to create highly personalized sites are currently poorly 
served by both personalization technology vendors and customer relationship marketing 
product vendors. Each of these vendors offers only part of the overall solution. In addition, a 
30 significant investment of time and resources by the client is required to deploy these current 
solutions. 

Most prior art personalization and Web user behavior (also known as clickstream) 
analysis technologies maintain a record of select Web pages that are viewed by users. This 
record, known as the "Web log" records which users looked at which Web pages in the site. 
35 A typical Web log entry includes some form of user identifier, such as an IP address, a cookie 
ID or a session ID, as well as the Uniform Resource Locator ("URL") the user requested, e.g. 



1 



"index.html." Additional information such as the time the user requested the page or the 

page from which the user linked to the current Web page can also be stored in the Web log. 
Traditionally, such data has been collected in the file system of a Web server and 

analyzed using software, such as that sold by WebTrends and Andromedia.. These analyses 
5 produce charts displaying information such as the number of page requests per day or the 

most visited pages. No analysis is performed of the internal Web page structure or content. 

Rather, this software relies on simple aggregations and summarizations of page requests. 
The prior art personalization methods also rely on the use of Web logs. One 

technology used in prior art personalization methods is the trend analysis method known as 
10 collaborative filtering. Examples of collaborative filtering systems are those of Net 

Perceptions (used for Amazon.com's book recommendations), Microsoft's Firefly, Personify, 

Inc., and HNC Software Inc.'s eHNC. 
3 One method of collaborative filtering is trend analysis. In trend analysis collaborative 

~ filtering, the pages requested by a user are noted, and other users that have made similar 
ii 1 5 requests are identified. Additional Web pages that these other users have requested are then 
^ recommended to the user. For example, if User A bought books 1 and 2 from an on-line 
; j bookseller, a collaborative filtering system would find other users who had also bought books 
;0 1 and 2. The collaborative filtering system locates 10 other users who on average also bought 
;^ books 3 or 4. Based upon this information, books 3 and 4 would be recommended to User A. 
J 20 Another type of collaborative filtering asks the users to rank their interest in a 

* document or product. The answers to the questions form a user profile. The documents or 

'"■4 

□ products viewed by other users with a similar user profile are then recommended to the user. 
3 Systems using this technique include Reel.com 5 s recommendation system. 

However, collaborative filtering is not an effective strategy for personalizing dynamic 
25 content. As an example, each auction of a Web-based auction site is new and therefore there 
is no logged history of previous users to which the collaborative filtering can be applied. In 
addition, collaborative filtering is not very effective for use with infrequently viewed pages or 
infrequently purchased products. 

Another technique used to personalize Internet content is to ask the users to rank their 
30 interests in a document. Recommendations are then made by finding documents similar in 
proximity and in content to those in which the user has indicated interest. These systems may 
use an artificial intelligence technique called incremental learning to update and improve the 
recommendations based on further user feedback. Systems using this technique include 
SiteHelper (Ngu and Wu, 1997), Syskill & Webert (Pazzani et al., 1996) Fab (Balabanovic, 
35 1997), Libra (Mooney, 1998) and Web Watcher (Armstrong et al., 1995). 
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Another technique that has been used to personalize Internet content is link analysis. 
Link analysis is used by such systems as the search engine Direct Hit and Amazon.com' s 
Alexa®. The prior art link analysis systems are similar to the trend analysis collaborative 
filtering systems discussed previously. In the link analysis systems, however, the URL of a 
5 web page is used as the basis for determining user recommendations. 

Other prior art personalization methods use content analysis to derive inferences 
about a user's interests. One such content analysis system is distributed by the Vignette 
Corporation. In the content analysis method, pages on a client's Web site are tagged with 
descriptive keywords. These tags permit the content analysis system to track the Web page 
10 viewing history of each user of the Web site. A list of keywords associated with the user is 
then obtained by determining the most frequently occurring keywords from the user's history. 
The content analysis system searches for pages that have the same keywords for 
recommendation to the user. 



consuming and subject to human error. The prior art content analysis systems can only offer 
recommendations from predefined categories. Furthermore, the prior art content analysis 1 
systems require a user to visit the client's Web site several times before sufficient data has 
been obtained to perform an analysis of the user's Web page viewing history. 



represent it as a bag of words. The systems then search for other similar documents and 
recommend the located documents to the user. Such systems include Letizia (Lieberman, 
1995) and Remembrance Agent (Rhodes, 1995). These content analysis systems base their 
recommendations only on the current document. The content of the documents in the user's 
25 viewing history are not used. 

Many Web sites offer configurable start pages for their users. Examples of 
configurable start pages include My Yahoo! and My Excite. To personalize a start page 
using the prior art method, the user fills in a form describing the user's interests. The user 
also selects areas of interest from predefined categories. The user's personalized start page is 
30 then configured to display recommendations such as Web pages and content-based 
information that match the selected categories. 

This prior art method, however, is not automated. Rather, the user's active 
participation is required to generate the personalized Web start page. Furthermore, pages on 
the client's Web site must be tagged to be available as a recommendation to the user. In 
35 addition, recommendations can only be offered from predefined categories. Thus, the prior 



J ^ This prior art content analysis systems is subject to several disadvantages. First, 

i;n 1 5 tagging each page on the client's Web site requires human intervention. This process is time- 




Other prior art content analysis systems automatically parse the current document and 
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art personalized start pages may not provide relevant content to users who have eclectic 
interests or who are not aware of or motivated to actively create a personalized start page. 

Content Web sites are increasingly generating income by using advertising directed at 
users of the Web sites. In the prior art, advertising was targeted to users by using title 
5 keywords. In this method, keywords in the title of a Web page or otherwise specified by the 
author of the page are compared with the keywords specified for a particular advertisement. 
Another technique used is to associate specific ads with categories in a Web site. For 
example, advertisements for toys might be associated with Web site categories related to 
parenting. However, these prior art methods require human intervention to select the 
10 keywords or to determine the associations of advertisements with particular categories. 

Furthermore, the prior art methods cannot readily be used to target advertisements to dynamic 
content. 

□ It would therefore be an advantage to provide a method and system for providing 

Internet end users with relevant and timely information that is rapid to deploy, easy and 
m 15 inexpensive for client Web sites to use. It would be a further advantage if such method and 
p system were available to automatically and dynamically determine the interests of a user and 
luj recommend relevant content to the user. It would be yet another advantage if such method 
ifl and system were available to provide for a user a personalized recommendation package, 
L such as an automatically generated start page for each user who visits a Web site. 



The present invention is a computer-implemented method and system for creating a 
personalized display for a user of an electronic network. The method can be used with any 

25 electronic network including the Internet and, more specifically, the World Wide Web. 

The present invention provides a user personalization service to businesses and 
organizations, preferably e-commerce and Internet businesses, that provide document servers. 
In the preferred embodiment of the invention, a tracking module is installed at a client 
document server. In the presently preferred embodiment, the client document server is a Web 

30 server. The tracking module determines whether each user who views a document on the 
client document server has a user-identifier ("user ID") installed on the user's computer. In 
the preferred embodiment of the invention, this user ID is in a cookie that is sent to the user's 
Web browser application. If no user ID is located, the tracking module sends a user ID to the 
user's computer. 

35 The tracking module logs every request made by every user for documents on the 

client document server. The tracking module sends the user ID and a document identifier 
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("document ID") to a marketing system in response to each user's request to view a 
document on the client document server. This information, including both document data 
and content data related to the user's activities and behavior while viewing the document on 
the client document server, is stored on a database associated with the marketing system. 
5 In the preferred embodiment, recommendation software operable on the marketing 

system is then used to analyze each document a user views in terms of the (a) content viewed 
by the user and (b) ancillary information. The recommendation software uses customizable 
filters that extract from the document only the content deemed to be relevant to a user. In 
addition to extracting the content of each page, the recommendation software uses filters to 
1 0 extract structure within this content. 

Given a set of documents that a user has viewed, the recommendation software is 
used to determine any common themes and concepts of the set. The recommendation 
3 software uses a document clustering process to group together those documents of the client 
Z document server that have been viewed by the user according to their common themes and 
;p 1 5 concepts. For each individual user, the recommendation software clusters those documents 

that have the most themes and concepts in common with one another into interest folders. 
-J The set of interest folders, in combination with any other structural information 

B regarding the user's behavior, is used by the recommendation system to derive a user interest 
^ profile. The user interest profile comprises one or more interest folders. In the preferred 
: J20 embodiment, each interest folder is automatically summarized in terms of the most relevant 
~ keywords from the associated collection of documents in the interest folder. The user's profile 
n can be summarized using these keywords to facilitate the automatic deriving of user's interest 
^ and intentions in viewing content and advertisements. Filters, such as the removal of 
"stopwords", can be used to screen out common prepositions, articles, possessives and 
25 irrelevant verbs, adjectives and nouns. 

The recommendation software can also be used to categorize documents to 
automatically place new documents into a user's existing predefined interest folders. 
The present invention uses the user's interest profile (the product of the analysis of document 
content) to provide a model for automatically deriving a ranking of user's interests and 
30 intentions in viewing particular documents. This model can then be used to rank the new 
documents so that the most relevant documents to a user's interests folder are automatically 
placed in that interest folder. 

The model can also be used to determine "recommended documents" and 
"recommendation packages", which contain suggested products and/or documents that are 
35 tailored to a user's interests and to the product and/or document that a user is currently 
viewing. In the preferred embodiment of the invention, the recommendation package 
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is a personalized Web start page for the user. 



BRIEF DESCRIPTION OF THE DRAWINGS 



5 Figure 1 is a flow diagram of the personalization method according to the present invention 
Figure 2 is a block diagram of a computer network system according to one embodiment of 
the present invention. 

Figure 3 is a diagram of the system for Internet personalization, according to the preferred 
embodiment of the invention. 
10 Figure 4 is a flow chart of the method for Internet personalization, according to the preferred 
embodiment of the invention 

Figure 5 is a flow chart illustrating the formation of interest folders, according to the present 
invention. 

Figure 6 is an example of a user profile generated by the recommendation software, 



<;n 1 5 according to the preferred embodiment of the present invention. 

!!* Figure 7 is an example of a recommendation start page according to the preferred 

W embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

The present invention is a computer-implemented method and system for creating a 
personalized display for a user of an electronic network. The method can be used with any 
5 electronic network including the Internet and, more specifically, the World Wide Web. The 
preferred embodiment of the present invention includes components for analyzing Web user 
behavior, for remote user tracking, and for interacting with the user. 

In the following description, for purposes of explanation, numerous specific details 
are set forth in order to provide a thorough understanding of the present invention. It will be 
1 0 evident, however, to one skilled in the art that the present invention may be practiced without 
the specific details. In other instances, well-known structures and devices are shown in block 
diagram form to facilitate explanation. The description of preferred embodiments is not 
□ intended to limit the scope of the claims appended hereto. 

:nl5 Features of the Invention: 

4 The present invention provides a user personalization service to businesses and 

& organizations that provide document servers. In the preferred embodiment, the invention is 

| 3 directed primarily to e-commerce and Internet businesses. The invention can be used to 

J 20 provide personalization and Web user behavior (referred to herein as "clickstream") analysis. 

"J This service enables e-commerce and Internet sites to deliver highly personalized and 

g relevant information to each of their users. The invention can be used with, but is not limited 

y to, content sites and e-commerce sites.. 

Figure 1 is a flow diagram of the personalization method according to the present 
25 invention. The invention uses the recommendation software to remotely collect and process 
end user behavior 100. Each user action is considered and analyzed in terms of the structural 
content of the document that is actually viewed by the user 105. The interests of the user are 
determined 1 10 and the user can thereby be provided with a list of recommended documents 
that are selected according to the analysis of the content of the documents viewed by the user 
30 1 15. In addition, the invention can also be used to generate a personalized recommendation 
package, such as, in the preferred embodiment, a personalized start page or a personalized 
product catalogue for each user. 

The present invention is advantageous because, by having more relevant information 
delivered to each end user, the client can draw users back to the client document server and 
35 can create a barrier to their switching to a competing document server. This can result in 

increased advertising revenue accruing to the client, and e-commerce clients can receive more 
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revenue from sales because each user will receive more relevant suggestions of products to 
buy and will return more regularly. 

The invention offers significant advantages to clients over the prior art personalization 
methods. For example, using the invention, a personalized recommendation package can be 
5 rapidly deployed, with minimal effect on the original client document server during 

deployment. The present invention avoids the requirement for clients to develop and invest 
in complex techniques for their own tracking and personalization and is therefore more 
economical than prior art personalization schemes. In addition, the present invention will 
enable clients to retain customers through improved one-to-one interaction as well as drive 
10 revenue from increased sales through cross-selling and up-selling of their products. 

Definitions: 

For purposes of this application, the present invention will be referred to as the 
"recommendation system". The use of the term recommendation system is in no way 

15 intended to limit the scope of the present invention as claimed herein. As described in further 
detail herein, the recommendation system can include any suitable and well-known hardware 
and software components, and in any well-known configuration to enable the implementation 
of the present invention. 

The present invention is also implemented using one or more software applications 

20 that are accessible to the recommendation system. For purposes of this application, these 
software applications will be called the "recommendation software." The use of the term 
recommendation software is in no way intended to limit the scope of the present invention as 
claimed herein. 

The personalization service according to the present invention is preferably provided 
25 by an entity, referred to for purposes of this application as the market analyst. The term 
"client," as used herein, refers to the operator of a document server. In the preferred 
embodiment of the present invention, the client is the operator/owner of a Web site. The term 
"user" refers herein to an individual or individuals who view a document served by the 
client's document server. 
30 The recommendation system can include the market analyst's computers and network 

system, as well as any software applications resident thereon or accessible thereto. For 
purposes of this application, these components will be collectively referred to as the 
"marketing system." The use of the term marketing system is in no way intended to limit the 
scope of the present invention as claimed herein. As described herein, the marketing system 
35 can include any suitable and well-known hardware and software components, and in any 
well-known configuration to enable the implementation of the present invention. In the 
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presently preferred embodiment, the marketing system is maintained separately from the 
client document server. However, in alternative embodiments, the hardware and software 
components necessary to provide the personalization service can be a part of the client 
document server. In these alternative embodiments, the hardware and software components 
5 can be operated by, for example, a client e-commerce or Internet business itself. 

The client's computers and network system, as well as any software applications 
resident thereon or accessible thereto will be collectively referred to, for purposes of this 
application, as the "document server." The term "document" is used to represent the display 
viewed by a user. In a Web-based embodiment, the document is a Web page. In an e-mail 
10 embodiment, the document can be an e-mail message or listing of messages, such as an in- 
box. 

As used herein, the term "database" refers to a collection of information stored on one 
or more storage devices accessible to the recommendation system and recommendation 
software, as described previously. The use of the term database is in no way intended to limit 
15 the scope of the present invention as claimed herein. 

The database according to the present invention can include one or more separate, 
interrelated, distributed, networked, hierarchical, and relational databases. For example, in 
the presently preferred embodiment of the invention, the database comprises a document 
database and a user database. The database can be created and addressed using any well- 
20 known software applications such as the Oracle 8™ database. The database according to the 
present invention can be stored on any appropriate storage device, including but not limited 
to a hard drive, CD-ROM, DVD, magnetic tape, optical drive, programmable memory device, 
and Flash RAM. 

The term "content sites" refers to Internet sites that are primarily providers of content 
25 based information such as news articles. Examples of content Web sites include CNET, 

MSN Sidewalk, and Red Herring. These sites can generate income from advertising, as well 
as syndication or referral fees for content. A content site's income can therefore be greatly 
dependent upon the Web site's ability to retain users. 

E-commerce sites are Internet sites whose primary business is the sale of goods or 
30 services. E-commerce businesses derive revenue from the sale of goods on their Web sites. 
A significant factor in the success of an e-commerce Web site is the site's ability to attract 
and retain customers. 

Syndicated content, as used herein, refers to other publisher's content that can be 
integrated into a client's document server. 

35 

Hardware Implementation: 
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Any or all of the hardware configurations of the present invention can be 
implemented by one skilled in the art using well known hardware components. In the 
presently preferred embodiment, the present invention is implemented using a computer. 
Such computer can include but is not limited to a personal computer, network computer, 
5 network server computer, dumb terminal, local area network, wide area network, personal 
digital assistant, work station, minicomputer, and mainframe computer. The identification, 
search and/or comparison features of the present invention can be implemented as one or 
more software applications, software modules, firmware such as a programmable ROM or 
EEPROM, hardware such as an application-specific integrated circuit ("ASIC"), or any 
1 0 combination of the above . 

Figure 2 is a block diagram of a computer network system 200 according to one 
embodiment of the present invention. Any or all components of the recommendation system, 

0 the marketing system, the client document server, and the user's computer can be 

r\ implemented using such a network system. In computer network system 200, at least one 

jj.iU; 

ff\ 1 5 client document server computer 204 is connected to at least one user computer 202 and to at 
least one marketing system computer 2 1 2 through a network 210. The network interface 
between computers 202, 204, 212 can also include one or more routers, such as routers 206, 
10 208, 214 that serve to buffer and route the data transmitted between the computers. 
j= 3 Network 210 may be the Internet, a Wide Area Network (WAN), a Local Area 

J 20 Network (LAN), or any combination thereof. In one embodiment of the present invention, 
r\ the client document server computer 204 is a World-Wide Web ("Web") server that stores 

1 □ data in the form of 'Web pages' and transmits these pages as Hypertext Markup Language 
^3 (HTML) files over the Internet network 210 to user computer 202. Similarly, the marketing 

system computer can also be a WWW server. Communication among computers 202, 204, 
25 212 can be implemented through Web-based communication. In some embodiments of the 
present invention, computers 202, 204, and 212 can also communicate by other means, 
including but not limited to e-mail. It should be noted that a network that implements 
embodiments of the present invention may include any number of computers and networks. 

30 Software Implementation: 

Any or all of the software applications of the present invention can be implemented 
by one skilled in the art using well known programming techniques and commercially- 
available or proprietary software applications. The preferred embodiment of the present 
invention is implemented using an Apache Web server and Web-based communication. 

35 However, one skilled in the art will recognize that many of the steps of the invention can be 
accomplished by, alternative methods, such as by e-mail. 

10 
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In the preferred embodiment of the invention, the operating system for the marketing 
system is Red Hat™ Linux®. However, any other suitable operating system can be used, 
including but not limited to Linux®, Microsoft Windows 98/95/NT, and Apple OS. 
The recommendation software can include but is not limited to a Web server 
5 application for designing and maintaining the market analyst's Web site, a database 

application for creating and addressing the database, software filters for screening the content 
of documents served by the client's document server, a text clustering application, a text 
categorization program, a presentation module, a spider and/or search engine for seeking 
relevant documents, an e-mail application for communication with users, a spread sheet 

10 application, and a business application for verifying orders, credit card numbers, and 
eligibility of customers. 

The recommendation software can include any combination of interrelated 
applications, separate applications, software modules, plug-in components, intelligent agents, 
cookies, JavaBeans , and Java applets. (Java and all Java-based marks are trademarks or 

1 5 registered trademarks of Sun Microsystems, Inc. in the United States and other countries.) 
The software applications that comprise the recommendation software can be stored on any 
storage device accessible to the marketing system, including but not limited to a hard drive, 
CD-ROM, DVD, magnetic tape, optical drive, programmable memory device, and Flash 
RAM. It will be readily apparent to one of skill in the art that the software applications can 

20 be stored on the same or different storage devices. 

In the preferred embodiment of the invention, the clustering application is 
implemented using the C programming language. However, in alternative embodiments, the 
clustering application can be implemented using other well-known programming languages, 
including but not limited to C++, Pascal, Java, and Fortran. The clustering application is 

25 preferably stored on the marketing system, but can alternatively be stored on any component 
accessible to the marketing system. 

In the preferred embodiment of the invention, the presentation module is implemented 
using Perl scripts and SQL. However, in alternative embodiments, the presentation module 
can be implemented in any other suitable programming language. The presentation module is 

30 preferably stored on the marketing system, but can alternatively be stored on any component 
accessible to the marketing system. 

In the preferred embodiment of the invention, the tracking module that is associated 
with the client's document server is implemented using Perl scripts. However, in alternative 
embodiments, the tracking module can be implemented using other well-known 

35 programming languages and software applications including but not limited to TCL, Java™ 
servlet, and Microsoft Active Server Page ("ASP") applications. The tracking module is 
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preferably stored on the client's document server, but can alternatively be stored on any 
component accessible to the document server. 

In the preferred embodiment of the present invention, content analysis and the 
generation of the user profiles, recommendations, and recommendation packages are all 
performed by the marketing system and recommendation software. However, in alternative 
embodiments of the present invention, any or all of these functions can also be performed by 
the client document server. The client document server performs the functions of data 
collection, data transfer to the marketing system and presentation of the recommendations 
and recommendation packages to the user. 

In the preferred embodiment of the invention, the database is implemented using Data 
Konsult AB's MySQL. However, in alternative embodiments, the tracking module can be 
implemented using other software applications including but not limited to Postgres, and 
Oracle® and Informix® database applications. The database is preferably stored on the 
marketing system server, but can alternatively be stored on any component accessible to the 
marketing system. 

The recommendation software is preferably a separate application from the marketing 
system operating system. However, one skilled in the art will readily recognize that the 
present invention can also be fully integrated into the marketing system operating system. 

Description of the Embodiments: 

Figure 3 is a diagram of the system 300 for Internet personalization, according to the 
preferred embodiment of the invention. A tracking module 306 is installed at the client 
document server 304. In the presently preferred embodiment, a Web site manager embeds 
Hypertext Markup Language (" HTML") links to the marketing system in the client 
document server and, specifically, on the client document server's start page. While the 
tracking module is implemented as a Perl module embedded in Apache in the preferred 
embodiment, the tracking can alternatively be implemented in other ways, for example using 
hypertext links. 

At the client document server 304, the tracking module logs every request made by 
every user for documents and sends this information to the database 310 associated with the 
marketing system 308. In the preferred embodiment of the present invention, the database 
310 includes a document database module 312 for storing information relating to the 
document and contents of the document, and a user database module 3 14 for storing 
information relating to the user's document viewing behavior. 
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In the preferred embodiment, each user is sent a user-identifier ("user ID") 316 that is 
stored on the user's computer 302. The tracking module sends the user ID and a document 
identifier ("document ID") 318 to the marketing system 308 in response to each user's 
request to view a document on the client document server 304. The recommendation 
software 320 is then used to process this information to construct a profile for the user and to 
make recommendations based thereupon. In the preferred embodiment, the presentation 
module 322 is operable to configure a recommendation package for the user into any desired 
format or appearance. 

Figure 4 is a flow chart of the method for Internet personalization, according to the 
preferred embodiment of the invention. A tracking module is installed at a client document 
server. In the preferred embodiment of the present invention, the client document server is a 
Web site. However, in alternative embodiments, the present invention is implemented with a 
client e-mail or File Transfer Protocol ("ftp") system. 

In this preferred embodiment, when a user requests a document on the client 
document server 400, the tracking module searches for a user ID on the user's computer 405. 
If a user ID is not located, the tracking module creates a new entry in the database and sends 
a user ID to the user's computer 410. In the preferred embodiment, this involves sending a 
cookie to the user's Web browser. However, any other appropriate identifier can 
alternatively be used, such as an IP number. 

The tracking module installed at the client document server logs every request made 
by every user for documents and sends this information to the marketing system. Thus, when 
the user requests a different document in the client's document server, the tracking module 
logs this action by sending the user ID and a document identifier ("document ID") to the 
database 415. In the presently preferred embodiment, the document ID is the URL of the 
particular Web page. However, other document IDs such as a product number can also be 
used. 

In alternative embodiments of the present invention, the tracking module can send 
additional information, such as the time spent viewing a document and the price of items 
displayed on the document to the marketing system database. The subsequent actions on the 
client document server of any user who is entered in the marketing system database are 
similarly recorded in the marketing system database. 

In yet another embodiment of the present invention, the marketing system can act as a 
proxy server. In this embodiment, the tracking module could be installed at either the 
marketing system or the client document server, or at both. In this embodiment, the user 
requests documents from the marketing system. In response to such request, the marketing 




13 



« PATENT 
ley Docket No.: 358.02 



system requests the appropriate documents from the client document server and provides 
them to the user. 

In the preferred embodiment, documents and meta-data about the documents are 
stored in the document database module of the database. The document database can include 
other information obtained from the client, such as the price or size of an item. The user 
database module can include information obtained from the user, for example, whether the 
user placed a bid on an item, the user's name and address, which documents were viewed by 
the user, whether the user purchased an item, user profile or the time the user spent viewing a 
particular document. Information obtained from text analysis, document clustering, or 
document categorization can also be stored in the user database module. 

As the user browses through the client's document server, the marketing system uses 
the recommendation software to process the user's behavior, analyze the content of the user's 
document views and construct a profile for the user 420. 

The recommendation software uses the information in the user database to make a 
determination of what interests the particular user. For example a user who browsed an 
auction Web site for antique Roman coins and baseball cards would be determined to have 
two interests. These interests are determined by an analysis of the actual content of each 
browsed document. 

The recommendation software uses any or all of the gathered information about the 
user to search through the content on the client's document server to find the local content 
considered most relevant to that particular user 425. In the preferred embodiment of the 
invention, the marketing system regularly retrieves the content for each document and/or 
product on the client document server, for example, once per hour. 

The recommendation software analyzes each document a user views in terms of the 
(a) content and (b) ancillary information related to a user's viewing a document. The present 
invention uses this analysis of document content to provide a model for automatically 
deriving reasonable inferences regarding a user's interests and intentions in viewing 
particular documents. This model can then be used to generate a list of additional documents 
on the client document server, or elsewhere such as on another document server, that might 
be of interest to the user. These "recommendation documents" and "recommendation 
packages" provide a suggested product and/or document that is tailored to a user's interests 
and to the product and/or document that a user is currently viewing. 

The marketing system sends the recommended document(s), or a link to the 
recommended document(s) back to the client's document server 430. The recommendations 
can include but are not limited to URLs, product numbers, advertisements, products, 
animations, graphic displays, sound files, and applets that are selected, based on the user 
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profile, to be interesting and relevant to the user. For example, the most relevant ad for any 
page can be rapidly determined by comparing the current user profile with the description of 
the available advertisements. 

The user recommendations can be provided as a part of a personalized 
5 recommendation package. In the preferred embodiment of the invention, the 

recommendation package is a personalized Web start page for the user. For an e-mail server- 
based embodiment, the recommendation package can be personalized e-mail. The 
recommendation package gives each end user a unique view of the client document server by 
showing information that is relevant to that user. 

10 In the preferred embodiment, the document displayed to the user by the client 

document server includes a hypertext link that is used to access the personalized Web start 
page. When the user clicks on the hypertext link, the personalized start page is dynamically 
generated by the recommendation software at the marketing system. Each user will see a 
different view of the Web site based on the user's personal likes or dislikes, as determined 

1 5 automatically by the user's previous browsing behavior. Such automatic personalization 

minimizes the need for the client to specifically control document server content and permits 
the client to transparently provide information regarding the user's interests. 

When the user clicks on a link to this personalized Web page on the client's document 
server, the personalized page is served to the user from the marketing system. Although the 

20 page is served from the marketing system, the presentation module is operable to configure 
the personalized page to conform to the client's own branding and image, thereby 
maintaining the look and feel of the client's site. In addition, the Uniform Resource Locator 
(" URL") link, which is the "Web address" of the personalized page is configured to appear 
to be a link to the client document server. 

25 In alternative embodiments of the present invention, the personalized Web page does 

not have to maintain the look and feel of the client's document server, but can have any 
desired appearance. In such embodiments, the presentation module is operable to configure 
the recommendation package into any desired format or appearance. Furthermore, there is no 
requirement that URL link provided to the user appear to link the Web page to any particular 

30 Web site. In one embodiment of the present invention, the user can switch back at any time 
to the from the personalized recommendation package, such as the personalized Web start 
page, to a non-personalized document, such as the generic start page of displayed by the 
client document server. 

In another embodiment of the invention, portions of the client's document server can 

35 be mirrored on the marketing system. The recommendation software can then search through 
the mirrored client document server for content relevant to the particular user. The 
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recommendation software can also optionally include syndicated content from the marketing 
system or from the client's syndication providers in the personalized page. New standards 
based on XML such as Information Content Exchange ("ICE") will facilitate the 
incorporation of syndication into Web sites. 

The recommendation software according to the present invention uses information 
regarding the client's document server structure in the personalization analysis. For example, 
if a user typically looks at books in a particular category of a bookseller's Web site, this 
information will be used by the recommendation software, in addition to any content 
information, to create a personalized view of the site for the user. 

Figure 5 is a flow chart illustrating the formation of interest folders, according to the 
present invention. _The recommendation software thereby extracts and organizes the interests 
and document viewing habits of the user. 

In the preferred embodiment of the invention, the recommendation software uses a 
statistical process referred to herein as document clustering to group together those 
documents of the client document server that have been viewed by the user according to their 
common themes and concepts. For each individual user, the recommendation software 
clusters those documents that have the most themes and concepts in common with one 
another into interest folders 505. In the preferred embodiment, the recommendation software 
continually monitors each user and continually updates the user's interest folders and profile. 

The set of interest folders for each user can also be used to target advertisements to 
each user rather than, or in addition to content. In the presently preferred embodiment, each 
advertisement has an associated simple description. This description is specified by the 
creator of the ad. The description can be associated with the advertisement by methods 
including embedding in meta-language tags or in XML. 

Document clustering according to the present invention includes the automatic 
organization of documents into the most intrinsically similar groups or segments. As an 
example of the application of using document clustering, a user who enters the search term 
"Venus" into a search engine will likely receive documents about (a) Venus the planet; and 
(b) Venus the goddess. In the preferred embodiment of the present invention, the search 
results would therefore be clustered accordingly into two separate interest folders. None of 
the concepts in groups (a) and (b) are predefined but are formed as a result of the intrinsic 
similarity of the documents in each cluster. As a result, the clustering framework is very 
flexible for automatic organization of documents into groups. 

In the preferred embodiment of the present invention, the recommendation software 
uses a proprietary clustering algorithm to form the user interest folders. The clustering 
algorithm uses the textual content of the documents viewed by a user, in combination with 
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structural information about the document server, and ancillary information about the user to 
determine the interest folders for a user. 

In an alternative embodiment, a clustering algorithm is also used to segment large 
numbers of users into different user folders. However, one skilled in the art would readily 
5 recognize that any other suitable clustering algorithm could also be used in alternative 
embodiments of the invention. 

One significant feature of the clustering algorithm used by the invention is that the 
output of the algorithm can be readily viewed and understood. Each document cluster 
(interest folder) is described by the most relevant keywords of the documents within the 
10 document cluster 510. This feature enables both users and marketers to understand and 
control the degree of personalization and targeting that is made. 

The recommendation software can also be used to categorize documents 515. 
3 Document categorization is the automatic placement of new documents into existing 

* predefined categories. Document categorization is used in the preferred embodiment of the 

m 15 present invention to select, from a database, documents that match a user's interest folders. A 

* document categorizer can learn how to place new documents into the correct categories so 
j that, for example, a new Web page or product can be automatically placed into the correct 

9 user interest folder. As an example, given a user interest folder containing documents about 
^ Roman coins, a document categorizer could select the most relevant products for that user 
J 20 from a particular Web site. 

^ Because Web pages are diverse in structure and form, the recommendation software 

n uses customizable filters that extract only the content deemed to be relevant to users. In 
M addition to extracting the content of each page, the recommendation software uses filters to 
extract structure within this content. The present invention can also use adaptive filtering 
25 algorithms that analyze a Web site and review different filter known structures to 
automatically find an appropriate filter for a particular Web site. 

For example, an on-line bookseller's Web page can display information regarding a 
book that is available for purchase. The Web page can include such structure as: book price, 
author, description, and reviews. The fields of the document database are preferably 
30 customized to the bookseller's Web page such that the names of each of these fields can 
automatically be stored therein. The fields of the user database are similarly configured for 
automatic storage of information obtained from the user. This information is then included in 
the recommendation software's analysis. 

In the preferred embodiment of the invention, the recommendation software uses 
35 proprietary filters that are specific for each Web site. For example, each of two music 
distribution Web sites would have its own specific customized filter. Alternatively, the 
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recommendation software can use filters that are specific for different types of Web sites. As 
an example, the recommendation software can have separate specific filters for such sites as 
auction Web sites, bookseller Web sites, and music Web sites. One skilled in the art would 
recognize that the recommendation software can also use any suitable commercially available 



In the preferred embodiment, each interest folder is automatically summarized in 
terms of the most relevant keywords from the associated collection of pages in the folder. 
Keywords can be determined, for example, by using an information theoretic measure such as 
"Minimum Message Length" ("MML")to determine the most relevant words to define a 

10 user's interest folder. Filters, such as the removal of "stopwords," can be used to screen out 
common prepositions, articles, possessives, and irrelevant nouns, adjectives, etc. 

The keywords for a user's interest folders can be determined in any appropriate 
manner. In one embodiment of the invention, the message length of sending each word using 
the population frequency of the word is determined. This message length is referred to herein 

15 as the population message length of the word. The message length of sending each word 
using the interest folder's frequency of the word is then determined. This message length is 
termed herein the interest folder message length of the word. For each keyword, the interest 
folder message length of that keyword is then subtracted from the population message length 
of the word. The keywords for the user's interest folders are defined to be the words in which 

20 this distance is the greatest. 

Figure 6 is an example of a user profile 600 generated by the recommendation 
software, according to the preferred embodiment of the present invention. The profile shown 
in the personalized Web page of Figure 6 comprises two different interest folders 602, 604 
for a user of an on-line auction Web site. Each interest folder contains pages which are 

25 intrinsically similar to one another and dissimilar to pages in other interest folders. 

A specific interest folder contains a set of links 610 to auctions the user has viewed 
that are related to the theme of the interest folder. An interest folder can also include 
additional information including but not limited to information regarding the history of the 
user's Internet viewing, recommendations for the user, a summary of the user's purchases. In 

30 the example illustrated in Figure 6, each interest folder also has an associated set of keywords 
612 that summarize the most important concepts of the particular interest folder, as 
determined by the recommendation software. 

In the preferred embodiment of the present invention, the user can display and edit the 
user profile of Figure 6. For example, if the user is no longer interested in Roman antiquities, 

35 this interest folder 612 can be deleted from the user profile. 
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It is common for a user to regularly return to particular Web sites to look for specific 
information having a similar theme. For example, a user of an on-line auction Web site who 
collects Roman coins might frequently return to the antiquities section of the auction Web 
site. The present invention uses the profile of each user to automatically find other relevant 
pages in the Web site to recommend to the user. In the previous example, the 
recommendation software would search through all of the auctions currently running on the 
on-line auction Web site to search for those that match most closely with each of the user's 
interest folders. 

The present invention uses a sophisticated search engine that can incorporate any or 
all of the content and ancillary information in the user profile. Figure 7 is an example of a 
recommendation start page 700 according to the preferred embodiment of the present 
invention. The user's interest folders 602, 604 are displayed on the recommendation 
document. Each interest folder includes links to documents 610 that the recommendation 
software has selected based upon the user's profile. In the previous example of the Roman 
coin collector, the folder relating to this interest 604 includes links to auctions for Roman and 
other ancient coins. 

In the preferred embodiment of the present invention, a user can view and manage the 
user's profile. Thus, in the previous example, the user may wish to remove certain sections of 
the profile in order to stop receiving recommendations about Roman coin auctions. The 
recommendation software user interface allows users to delete interest folders, add extra 
keywords to an interest folder, or create their own interest folder from pages on a client 
document server. 

Because the user profiles are based primarily on keywords, the present invention 
can be used to not only target a user with content from the same Web site that the user is 
currently browsing, but also with content from other Web sites. For example, a user with an 
interest in collecting Roman coins could be automatically targeted with content from on-line 
publications related to antiquities. 

While the present invention is designed to automatically match users with relevant 
content, it is recognized that a client might wish to customize the manner in which users 
receive special promotions, event announcements and special news items. In the example of 
the Roman coin collector, a marketer of cruises might wish to target the collector with a 
promotion for a cruise of the Mediterranean. 

To enable marketers to interact easily with their users, the present invention provides 
the functionality to allow a marketer to search through the users' profiles using keywords in a 
standard search paradigm. Groups of users can be selected and then matched with relevant 
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content either by hand or automatically using the present invention's content matching 
technology. 

While the invention is described in conjunction with the preferred embodiments, this 
description is not intended in any way as a limitation to the scope of the invention. 
Modifications, changes, and variations which are apparent to those skilled in the art can be 
made in the arrangement, operation and details of construction of the invention disclosed 
herein without departing from the spirit and scope of the invention. 

One skilled in the art will readily recognize that, in an embodiment that features Web- 
based interaction between the user, the market analyst, and the marketer, there are many 
different ways in which communication can be implemented through the Web page graphical 
user interface. For example, this communication can be implemented using elements 
including but not limited to a dialog box, check box, combo box, command button, list box, 
group box, slider bar, text box. 

In the preferred embodiment of the present invention, all client's and users use 
computer-implemented methods to interact with the market analyst, for example, using a 
Web page or e-mail. However, in alternative embodiments, one or more such customers can 
communicate with the market analyst using other methods of communication, including but 
not limited to telephone, fax, and mail. For example, in one embodiment, a user can request 
modifications to the user's profile by making a telephone call to a client or to the market 
analyst. 
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